REPORT  DOCUMENTATION  PAGE 

Form  Approved 

OMB  No.  074-0188 

Public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and  maintaining 
the  data  needed  and  completing  and  reviewing  this  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information,  including  suggestions  for 
reducing  this  burden  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington,  VA  22202-4302,  and  to  the  Office  of 
Manaaement  and  Budaet.  Paperwork  Reduction  Project  (0704-0188),  Washington,  DC  20503 _ _ _ _ _ _ — — - 

1.  AGENCY  USE  ONLY  (Leave  2.  REPORT  DATE 

blank)  December  2001 

3.  REPORT  TYPE  AND  DATES  COVERED 

Magazine 

4.  TITLE  AND  SUBTITLE 

Gateway:  Volume  XII,  Number  4 

5.  FUNDING  NUMBERS 

SPO70 0-9 8-D- 4001 

6.  AUTHOR(S) 

Stefan  Conts table,  PhD 

Barbara  Palmer 

Mark  Rayson 

AnHrpw  S.  Jackson,  et .  al  . 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Human  Systems  IAC 

2261  Monahan  Way,  Bldg.  196 

WPAFB  OH>  45433-7022 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

GWXII4 

9.  SPONSORING  /  MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

Booz  Allen  &  Hamilton  Inc. 

4141  Colonel  Glenn  Highway 

Dayton,  Oh  45431 

10.  SPONSORING  /  MONITORING 

AGENCY  REPORT  NUMBER 

11.  SUPPLEMENTARY  NOTES 

12a.  DISTRIBUTION  /  AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  is  unlimited. 

Free  to  public  by  contacting  the  Human  Systems  IAC. 

Frpp  on  internet  at  http://iac.dtic.mil/hsiac 

12b.  DISTRIBUTION  CODE 

A 

13.  ABSTRACT  (Maximum  200  Words) 

This  issue  contains  articles  on  the  following  subjects:  l.The  Process  of  Physical  Fitness 
Standards  Development.  2.  History  of  Occupational  Demands  Measurement  and  the  Services’ 
Physical  Fitness  Standards  Development.  3 . Health-Related  Fitness  Standards;  A  Baseline 
Approach.  5. A  calender  of  human  systems  events.  6. Job  analysis.  7. Types  of  Physical 
Performance  Tests.  8. Physical  Test  Validation  for  Job  Selection.  9. Products.  10. 

Establishing  Performance  Standards.  11. Legal  Issues  Related  to  Employment  Practices. 

14.  SUBJECT  TERMS 

Physical  Fitness  Standards  Physical  Performance  Tests 

Products  Performance  Standards  Legal  Issues 

15.  NUMBER  OF  PAGES 

16 

16.  PRICE  CODE 

17.  SECURITY  CLASSIFICATION 
OF  REPORT 

UNCLASSIFIED 

18.  SECURITY  CLASSIFICATION 
OF  THIS  PAGE 

UNCLASSIFIED 

19.  SECURITY  CLASSIFICATION 

OF  ABSTRACT 

UNCLASSIFIED 

20.  LIMITATION  OF  ABSTRACT 

UNLIMITED 

NSN  7540-01-280-5500  Standard  Form  298  (Rev.  2-89) 


Prescribed  by  ANSI  Std.  Z39-18 
298-102 


20020415  027 


httD://iac.dtic.mii/hsiac 


Volume  XII:  Number  4  (2001) 


iiiman  Svstems  IAC 


Published  by  the  Human  Systems  Information  Analysis  Center 


Job  Performance 


Special  Issue: 

Physical  Fitness  Standards 
Development  SOAR 


History  of  4 

Occupational 

Demands 

Measurement  and  the 
Services’  Physical 
Fitness  Programs 


</> 

|2 


(/) 

Q) 

C 

-M 

LE 


CO 

00 

CT3 

a. 


cr> 

LL. 


Can  Do 

Cart  not  Do 

A 

True  Positives 

False  Positives 

C 

D 

False  Negatives 

True  Negatives 

A  +  C 

1  l 

i  +  D  | 

A 

Sensitivity  =  A  +  C  j 

1  D  1 

1  Specificity  =  +  D  j 

A  + 

Positive  predictive  value  = 

A 
A  + 

C  +  D 

Negative  predictive  value  = 
D 

C  +  D 


Health-Related  Fitness 
Standards:  A  Baseline 
Approach 

1 

Calendar 

1 

Job  Analysis 

10 

Types  of  Physical 
Performance  Tests 

11 

Physical  Test 

Validation  for  Job 
Selection 

12 

Products 

<1 

1  & 

Establishing 

Performance 

Standards 

"f 

The  real  goal  of  any  testing  standard  approach  is  to  maximize  tbs  correct  predictions  of  (job)  suc¬ 
cess  or  failure  (cells  A  &  D)  and  minimize  the  incorrect  assessments  (cells  B  &  C).  This  is  a  notion¬ 
al  example  of  a  contingency  table  and  is  analogous  to  the  classical  truth  table  used  in  testing  the 
null  hypothesis  (HO)  tor  Type  I  (a)  and  Type  II  (b)  error.  There  are  many  ways  to  “cut  the  pie”,  and 
this  depiction  well  represents  a  major  theme  o?  this  SOAR:  The  primary  goal  of  developing  highly 
valid  test  standards  can  become  surprisingly  challenging. 


Legal  Issues  Related 
to  Employment 
Practices 


15 


The  Process  of 

Standards 

Development 

Stefan  Constable,  Ph.B. 

Chief,  Performance  Enhancement  Division 
USAF  School  of  Aerospace  Medicine 


fETooihe  ancient  Greeks  set  great  value  on  the 
I  physical  fitness  of  the  individual,  which 
I  was  considered  to  be  related  to  success  in 
war  and  the  basis  for  good  health.  More  recently 
there  has  been  considerable  interest  both  in  job 
performance  and  standards  for  physical  fitness, 
especially  within  the  modern  Armed  Services.  The 
strong  association  between  increased  levels  of 
physical  fitness  and  decreased  morbidity  and  mor¬ 
tality  has  also  been  increasingly  recognized  over 
the  several  decades.  Overall,  individuals  may 
regard  fitness  in  a  more  varied  fashion  depending 
on  personal  interests,  occupation,  sex  and  age,  but 
these  idiosyncrasies  (or  individual  views)  general¬ 
ly  extrapolate  well  to  the  physical,  social  and  psy¬ 
chological  well  being  of  the  human  organism. 

continued  on  next  page 
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Personally,  as  one’s  exposure  to  this 
field  progresses,  it  has  become  exceeding¬ 
ly  intriguing,  both  with  regard  to  the  sup¬ 
porting  science,  as  well  as  the  practical 
implementation  of  the  fitness  standards 
process  itself.  This  interest  and  quest  for 
more  information  ultimately  led  to  the 
evolution  of  “The  Process  of  Physical 
Fitness  Standards  Development”  state-of- 
the-art  report  (SOAR).  Thus,  this  SOAR 
attempts  to  document  the  methods, 
processes,  and  issues  that  are  involved 
with  the  development  of  physical  fitness 
standards  with  special  reference  to  the 
military.  This  Gateway  presents  seven 
separate  synopses  from  that  SOAR,  with 
each  article  summarizing  a  chapter. 

Overall,  there  is  a  general  acceptance 
regarding  a  level  of  required  mental  per¬ 
formance  for  entry  or  advancement  in  the 
formal  education  process.  Various  organi¬ 
zations  have  sought  to  establish  both 
mental  and  physical  standards  for  job 
candidate  assignment  and  worker  reten¬ 
tion  in  order  to  ensure  job  performance 
and  safety.  The  processes,  however,  are 
hardly  as  straightforward  or  black  and 
white  as  most  might  envision.  For  exam¬ 
ple,  H.E.  Johnson  (circa  1946)  suggested: 

Quantitative  assessment  of  physical  fitness  is 
one  of  the  most  complex  and  controversial 
problems  in  applied  physiology  The  situation 
arises  in  part  from  lack  of  general  agreement 
on  what  constitutes  fitness  for  withstanding 
various  types  of  stress ,  and  in  part  from  lack 
of  agreement  on  what  measurements  allow 
valid  comparisons  to  be  made  among  different 
individuals  exposed  to  the  same  stress. 

In  fact,  it  has  been  recommended  that 
perhaps  both  good  science  and  good  judg¬ 
ment  are  required  in  equal  measure. 
Ideally,  the  incorporation  of  standards  for 
acceptable  performance  on  tests  of  physi¬ 
cal  capacity  should  be  scientifically  (and 
legally)  defensible!  However,  the  “rigors  of 
review”  may  sometimes  be  relaxed.  For 
example,  performance  on  current  military 
fitness  tests  often  does  not  correlate  well 
with  task  specific,  job  requirements,  espe¬ 
cially  those  involving  muscular  strength, 
i.e.,  heavy  lifting  or  carrying.  Current  law 
enforcement  and  fire  fighter  programs  may 
often  suffer  from  these  same  shortfalls. 

Relatively  few  new  initiatives  have  been 
identified  or  implemented  by  the  services 
to  update  and  improve  their  approach  to 


the  fitness  standards  process,  particularly  with  regard 
to  occupational  performance  and  health  considera¬ 
tions.  This  may  in  part  be  due  to  the  lack  of  a  better- 
organized  and  published  base  of  knowledge  concern¬ 
ing  the  primary  issues  of  standards  development. 
Therefore,  an  underlying  theme  in  this  text  is  that  the 
scientific  process  to  establish  defensible  standards  can 
be  complex  and  subject  to  interpretation  and  chal¬ 
lenge.  More  specifically,  it  may  not  always  be  possible 
to  achieve  the  desired  degree  of  test  validity.  For  exam¬ 
ple,  cost-benefit  concerns  and  resource  considerations 
may  be  overly  constraining  in  certain  settings  relative 
to  the  expected  outcomes,  i.e.,  only  modest  test  sensi¬ 
tivity  and  specificity  is  actually  achieved.  So  in  prac¬ 
tice,  the  process  can  be  varied  or  abbreviated  and  may, 
at  times,  involve  rather  arbitrary  final  decisions. 

Setting  resource  considerations  aside,  future 
advances  in  this  arena  may  only  come  from  more  novel 
analytical  approaches,  like  a  multivalued  logic  or 
“fuzzy  logic”  approach  (very  briefly  a  “fuzzy  set”  ties 
a  curve  or  a  point  in  a  cube  to  a  concept,  which  may 
better  equate  to  our  “common  sense”).  For  example,  it 
has  been  argued  by  animate  (versus  inanimate)  sys¬ 
tems  theorists  that  conventional  mathematics  (precise¬ 
ly  defined  points,  functions,  etc.)  are  not  adequate  for 
coping  with  the  analysis  of  biological  systems.  Further, 
to  deal  with  the  much  more  complex  human  system, 
radically  different  kinds  of  mathematics  are  warranted. 
Such  an  approach  would  incorporate  less  distinct  or 
fuzzy  quantities  that  do  not  lend  themselves  to  the 
more  conventional  parameters  of  probability  distribu¬ 
tions.  And  other  “out  of  the  box”  decision  analysis 
approaches  to  this  problem  may  evolve  as  well. 

In  summary,  this  reference  document  strives  to  pro¬ 
vide  an  organized  base  of  knowledge  concerning  the 
primary  issues  of  standards  development  as  they 
might  apply  to  both  the  military  and  civilian  environ¬ 
ments.  Much  of  the  material  is  technically  in-depth, 
but  certain  segments  lend  themselves  to  larger  target 
audiences  as  well.  Chapters  written  by  academic, 
industry,  or  military  subject-matter  experts  cover  all  of 
the  key  topics  that  are  relevant  to  this  field.  These  spe¬ 
cific  contributing  authors  bring  a  unique  breadth  of 
background  and  experience  from  the  academic,  mili¬ 
tary,  industrial  and  laboratory  fields.  Ultimately,  the 
goal  is  to  make  decisions  concerning  this  process 
through  the  judicious  identification,  evaluation  and 
application  of  the  most  relevant  information,  n 

This  issue  features  excerpts  from  the  recently  pub¬ 
lished  state-of-the-art  report  (SOAR)  “ The  Process 
Fitness  Standards  Development a  joint  project  of 
the  IISIAC  Program  Office  and  Dr.  Stefan  Constable 
of  the  Performance  Enhancement  Division  of  the 
US.  Air  Force  School  of  Aerospace  Medicine.  This 
SOAR  was  written  by  military  and  civilian  subject 
matter  experts  in  order  to  promote  a  more  system¬ 
atic  and  meaningful  approach  in  the  development 
of  physical  fitness  standards. 
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he  Center  for  Operational  Performance 
j.  Enhancement  at  the  USAF  School  of 
Aerospace  Medicine  (SAM)  (San  Antonio, 
TX  area)  is  expecting  a  position  for  a  Human 
Factors  Engineer/Psychologist  to  be  filled  in  CY 
2002. 

The  position  will  function  as: 

1 .  A  primary  technical  resource  for  the  AF 
Medical  Service  concerning  human  fac¬ 
tors  and  related  operational  perform¬ 
ance  enhancement  issues, 

2.  Technical  support  for  wing  level  human 
performance  training  teams, 

3.  To  support  the  USAFSAM  as  a  scientific 
consultant. 


or  a  related  scientific  discipline.  A  Ph.D.  is  high¬ 
ly  desired.  Must  have  research  experience  in  the 
applied  arena.  Work  will  require  occasional 
travel  away  from  the  normal  duty  station  on 
military  or  commercial  aircraft.  Must  exhibit  a 
high  degree  of  judgment,  resourcefulness,  orig¬ 
inality,  and  the  ability  to  foresee  the  impact  of 
changing  technology. 

Interested  individuals  should  contact  LtCol 
Bruce  Wright  at  the  address  below. 

Bruce  Wright,  LtCol,  USAF,  BSC,  Ph.D. 
Performance  Enhancement  Division 
USAF  School  of  Aerospace  Medicine 
2602  West  Gate  Road,  Building  775 
Brooks  AFB,  TX  78235-5252 


Applicants  must  have  a  masters  degree  (or  Phone:  (210)  536-4612 

significant  work  experience)  in  human  factors  Fax:  (210)  536-3683 


|  The  latest  Human  Systems  IAC 

state-of-the-art  report  (SOAR) 
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Knowing  how  fit  personnel  should  be  is  one  focus  of  the  field  of  occupational  demands  measurement — a 
field  that  has  its  roots  in  the  fields  of  industrial  engineering  and  occupational  assessment,  individual  dif¬ 
ferences,  and  physical  fitness.  This  State-of-the-Art  Report  documents  the  methods,  processes,  and 
tissues  that  are  involved  with  the  development  of  physical  fitness  standards  with  special  reference  to  the 
military  and  strives  to  provide  an  organized  base  of  knowledge  concerning  the  primary  factors  of  stan¬ 
dards  development.  Chapters,  each  written  by  a  military  or  civilian  subject-matter  expert,  focus  on  his- 
|ory  of  occupational  demands  assessment,  health-based  fitness  standards,  job  analysis,  types  of 
;j  fitness  tests,  test  validity,  setting  performance  standards,  and  legal  issues.  This  review  is 
S|fgue  In  both  its  scope  and  timeliness  of  information.  Authors  and  reviewer— Debby  Gebhardt, 
Ibny  Jackson,  Jim  Hodgdon,  Mark  Rayson,  and  Jim  Vogel. 

$oftbound,  356  pages.  Editors:  Stefan  Constable  and  Barbara  Palmer) 

available  for  $45“  (US)  plus  shipping  and  handling. 

ITo  order,  telephone:  937-255-4842,  fax:  937-255-4823,  or 
§|jfail:  michelle.dahle@wpafb.af.mil. 
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ilitary  fitness  has  been  an  issue 
for  as  long  as  militia  have  exist¬ 
ed.  A  progression  of  quantita¬ 
tive  approaches  to  workplace  activities 
has  led  to  today’s  interest  in  establishing 
occupational  fitness  standards.  Among 
the  early  researchers  was  Frederick  W. 
Taylor  (Taylor,  1923),  who  espoused  the 
practice  of  scientific  management. 
Taylor  was  able  to  use  this  method  to 
form  the  basis  for  training,  performance 
measurement,  incentives,  and  compen¬ 
sation.  Following  Taylor’s  quantitative 
view  of  the  workplace  were  Lillian  and 
Frank  Gilbreth,  who  developed  a  related 
concept,  that  of  motion  study  (Gilbreth, 
1901).  The  greatest  contribution  to  occu¬ 
pational  assessment  methodology  dur¬ 
ing  recent  decades  was  Edwin 
Fleishman’s  work  (1964).  Fleishman 
conducted  the  first  systematic  research 
to  determine  the  number  of  attributes 
necessary  to  generate  an  adequate  tax¬ 
onomy  of  physical  performance. 

Parallel  efforts  in  the  field  of  applied 
scientific  psychology  during  the  late 
1880s  to  the  early  1900s  were  focused 
on  understanding  and  measuring  differ¬ 
ences  among  individuals,  a  field  known 
as  psychometrics.  In  the  late  1880s, 
Francis  Galton  gathered  data  on  both 
physical  and  psychological  characteris¬ 
tics  (Thorndike  &  Hagan,  1969),  being 
interested  first  in  techniques  of  precise 
measurement  and  secondarily  in  the 
development  of  statistical  procedures 
with  which  to  make  the  data  meaning¬ 
ful.  The  work  of  both  Galton  and  James 
McKeen  Cattell  focused  on  human 
development,  with  the  hope  that  assess¬ 
ment  of  individual  traits  could  be  used 
in  educational  and  vocational  arenas. 

Fitness  standards  in  the  military  have 
been  established  over  the  years  to  pro¬ 
mote  health  and  general  physical  fitness. 
DoD’s  guidance,  through  Department  of 


Defense  Directive  1308.1,  requires  that  the  services 
establish  a  physical  fitness  and  body  fat  program 
that  includes  fitness  requirements  for  all  service 
members  (U.S.  Department  of  Defense,  1995).  This 
guidance  requires  that  regardless  of  age,  all  service 
members  be  measured  along  three  dimensions 
annually:  cardiovascular  endurance;  muscular 
strength  and  endurance;  and  maintenance  of  body 
fat  within  a  certain  percentage  range.  The  guidance 
does  not  specify  particular  testing  activities  or  min¬ 
imum  required  levels  of  difficulty.  Each  military 
service  is  required  to  design  its  own  fitness  pro¬ 
gram  to  meet  mission-specific  needs  (U.S. 
Department  of  Defense,  1995)  (see  Table  1,  page  5). 

The  purpose  of  job-specific  physical  performance 
standards  is  to  ensure  that  personnel  assigned  to 
physically  demanding  jobs  can  perform  those  jobs. 
Occupational  fitness  standards  indicate  the  level  at 
which  an  individual  must  perform  in  order  to  suc¬ 
cessfully  meet  job  requirements,  regardless  of  body 
size  or  gender.  The  GAO  report  (Government 
Accounting  Office,  1996)  recommended  establish¬ 
ing  valid  performance  standards,  providing  job 
training,  and  redesigning  job  tasks. 

Up  until  the  time  of  its  most  current  program 
change,  the  Army  established  minimum  require¬ 
ments  for  its  Army  Fitness  Test  on  data  collected  in 
the  1980s  (GAO,  1998b).  Last  year,  the  Army  began 
to  implement  new  standards  that  are  based  on  a 
more  statistically  valid  sample  base  than  in  the 
past.  The  policy  behind  the  new  standards  is  gen¬ 
der-neutral  with  minimum  requirements  generally 
set  on  the  8th  percentile  of  actual  scores  gathered 
during  an  Army  study  in  1995.  Maximums  are 
based  on  90th  percentile  scores,  and  requirements 
are  reduced  in  five-year  age  increments.  The 
Army’s  current  maximum  body  fat  for  males  is  20 
percent,  increasing  by  two  points  for  every  10 
years  after  the  age  of  29.  The  Army’s  standards  for 
females  were  determined  by  adding  8  percentage 
points  to  the  male  standard  for  each  category.  In 
1991,  the  female  standards  were  made  less  strin¬ 
gent  (from  28  to  34  percent  to  30  to  36  percent). 

Navy  standards  for  fitness  test  events:  VA  mile 
run/walk,  push-ups,  and  sit-ups— for  men  30  and 
older  are  based  on  distributions  of  actual  scores 
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Table  1.  Comparison  of  basic  characteristics  of  the  physical  programs  of  the  four  services. 


Regulation  350-41,  600-9,  and 

600-63,  FM  21-20 

Instruction  61 10.1  F 

Instruction  40-501  and  40-502 

Orders  6100.3J,  6100.10B, 

and  6100.4F 

Combat  and  operational  readiness 
Healthy  life  style 

Military  appearance 

Optimal  health 

Stamina  for  optimal  readiness 

Motivation  to  train 

Fit  and  healthy  force 

Overall  fitness 

Mission/combat  readiness 

Aerobic  capacity 

Upper  body/trunk  strength/endurance 

Body  fat 

Aerobic  capacity 

Upper  body/trunk  strength/endurance 

Flexibility 

Body  fat 

Aerobic  capacity 

*Upper  body/trunk  strength/endurance 

Body  fat 

Aerobic  capacity 

Upper  body/trunk  strength/endurance 
Body  fat 

2-mile  run 

Push-up 

Sit-up 

Weight-for-Height  Standards 

Body  fat  by  tape  (if  individual 
exceeds  weight-for-height 
standards) 

1 . 5-mile  run/walk,  or  500  yard  swim 
Curl-up 

Push-up 

Sit  and  reach 

Weight-for-Height  Standards 

Body  fat  by  tape  (if  individual 
exceeds  weight-for-height  standards) 

Submax  cycle  ergometer  prediction 

of  V02  max 

*Push-up 

*Ab  crunch 

Weight-for-Height  Standards 

Body  fat  by  tape  (if  individual  exceeds 
weight-for-height  standards) 

3-mile  run 

Ab  crunch 

Pull-up  (male) 

Flexed  arm  hang  (female) 
Weight-for-Height  Standards 

Body  fat  by  tape  (if  individual  exceeds 
weight-for-height  standards) 

*  Proposed  addition,  trial  period  in  to  CY  2002 


among  the  extant  population  gathered  during  the 
past  two  years.  Earlier  minimum  requirements 
(GAO,  1998a)  were  set  at  the  10th  percentile  and 
maximums  at  the  90  to  95th  percentiles.  However, 
for  the  run  time  for  women,  an  arbitrary  increment 
of  time  was  added  to  the  men’s  standard  rather  than 
being  based  on  actual  run  times  of  women.  The 
Navy  body  composition  standards  are  based  on  the 
National  Institutes  of  Health  definition  of  obesity. 
Navy  scientists  converted  the  weight-for-height 
table  data  into  mean  body  fat  percentages  of  about 
22  percent  for  males  and  33  percent  for  females. 

A  1998  GAO  report  (GAO,  1998b)  concluded  that 
Air  Force  officials  had  no  published  studies  or 
other  records  to  document  the  rationale  for  their 
cardiovascular  endurance  standards,  but  an  infor¬ 
mal  account  of  the  Air  Force’s  fitness  history 
reveals  that  the  cardiovascular  standard  was  based 
on  limited  normative  statistics  from  a  population 
of  Air  Force  men  and  women  in  the  early  1990s. 
The  population  was  divided  into  quintiles.  The  Air 
Force  is  fielding  its  new  strength  test,  with  stan¬ 
dards  that  will  likely  be  based  on  Army  standards 
with  some  possible  refinements  derived  during 
this  fielding  period.  The  Air  Force  is  currently  con¬ 
sidering  a  two-tier  approach  to  body  composition 
standards.  The  first  tier  would  deal  with  health 
and  readiness,  and  the  second  tier  would  represent 
job  specific  standards  (Wilkinson,  Kampert,  Blair, 
Baumgartner,  &  Constable,  2000). 

Marine  Corps  standards  were  probably  based  on 
1967  studies  showing  average  3-mile  run  times, 
with  maximum  times  set  at  the  90th  percentile  and 
minimums  at  the  10Ih  percentile.  Studies  conducted 
in  1993  and  1996  revealed  about  a  3-minute  differ¬ 
ence  in  run  times  between  men  and  women,  so 
this  3-minute  difference  was  added  to  the  men’s 


standard  scores  to  form  the  standards 
for  females  (GAO,  1998a). 

The  Marine  Corps  body  fat  standards 
appear  to  be  based  on  command  judg¬ 
ments  for  fitness  and  appearance, 
according  to  the  GAO  (GAO,  1998a). 
Some  limited  research  may  have  been 
applied.  The  maximum  allowable  body 
fat  for  male  Marines  is  only  18  percent, 
and  the  female  standard  is  26  percent,  r 
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Organizations  have  sought  to 
establish  standards  for  job  can¬ 
didate  assignment  and  worker 
retention,  in  order  to  ensure  job  per¬ 
formance  and  safety.  The  incorporation 
of  standards  for  minimal  performance 
on  tests  of  physical  capacity  should  be 
scientifically  defensible:  sometimes  a 
lofty  goal!  As  an  underlying  theme  in 
this  text,  the  scientific  process  to  estab¬ 
lish  defensible  standards  should  be  con¬ 
sidered  complex  and  varied.  Therefore, 
it  may  not  always  be  possible  to  achieve 
the  desired  degree  of  test  validity. 
Rather,  one  must  sometimes  live  with 
what  is  at  least  minimally 
acceptable/defensible.  Furthermore, 
cost-benefit  concerns  and  resource  con¬ 
siderations  may  be  overly  constraining 
to  the  idealized  standard  outcomes.  On 
the  other  hand,  there  are  many  work¬ 
place  scenarios  where  the  physical 
requirements  of  the  job  are  often  quite 
low,  but  there  is  still  significant  interest 
in  achieving  or  maintaining  a  reasonable 
level  fitness  for  all  workers.  This  can  be 
attributed  to  a  variety  of  reasons,  includ¬ 
ing  personal  health  and  appearance, 
everyday  work  efficiency,  good  cognitive 
functioning,  and  occupational  readiness. 
Clearly  the  greatest  health  benefits  are 
derived  when  one  improves  from  low  or 
very  modest  levels  of  initial  physical  fit¬ 
ness.  Relatedly,  this  chapter  has 
attempted  to  build  a  rationale  for  an 
ancillary  approach  to  fitness  standards 
development:  health-based  fitness  levels. 

The  challenges  with  instituting  job- 
specific  performance  tests  in  the  military 
or  elsewhere  are  identified  throughout 
’’The  Process  of  Physical  Fitness 
Standards  Development”  state-of-the 
art-  report  (SOAR).  Interestingly,  per¬ 
formance  on  current  military  fitness 
tests  does  not  appear  to  correlate  well 
with  performance  on  task-specific  job 


tests  required  for  many  military  vocations.  The  sci¬ 
entific  literature  is  now  replete  in  supporting  the 
strong  association  between  physical  activity/fitness 
and  general  heath,  wellness  and  quality  of  life. 
Thus,  the  issue  of  a  general  or  baseline  fitness 
requirement  in  the  workplace  population  or  the 
military  is  twofold — a  basic  level  of  fitness  for  over¬ 
all  health,  and  increased  levels  of  fitness  for 
improved  performance  for  occupational  and  recre¬ 
ational  activities.  Thus  we  postulate  that  health- 
based  standards  are  viable  as  an  adjunctive 
approach  to  the  physical  fitness  standards  process. 
There  may  be  greater  specific  application  opportu¬ 
nities  for  the  military. 

The  focus  of  Chapter  2  is  therefore  to: 

1 .  Document  the  specific  relationship 
between  physical  activity  or  fitness  and 
specific  health  outcomes; 

2.  Review  exercise  prescription  and  investi¬ 
gate  the  quantitative  relationships  between 
physical  activity  benefits  and  measured 
levels  of  fitness; 

3.  Identify  those  attempts  to  produce  a  specif¬ 
ic,  health  related  cut-point  for  the  specified 
fitness  components;  and 

4.  Assess  at  least  qualitatively,  the  validity  of 
those  heath-based  fitness  approaches. 

More  specifically,  three  categories  (or  modalities) 
for  health  related  fitness  have  been  identified  as  car¬ 
diorespiratory,  musculoskeletal  and  body  composi¬ 
tion,  although  it  is  recognized  that  an  analogous 
grouping  termed  “metabolic  fitness”  could  also  be 
considered.  Since  there  are  many  lifestyle  and  envi¬ 
ronmental  influences  as  well  as  genetic  factors  that 
are  all  related  to  overall  health,  it  is  also  difficult  to 
isolate  specific  types  and  amounts  of  activity  for 
each  person  as  direct  predictors  of  optimized  well¬ 
ness.  The  key  issue  here  of  dose-response  should  be 
viewed  as  the  description  of  how  much  and  what 
type  of  physical  activity  is  required  to  achieve 
health-related  or  specific  performance  outcomes. 
Further,  the  specific  dose  parameters  (volume, 
intensity,  modality)  associated  with  health  respons¬ 
es  will  normally  be  quite  different  that  those  typi- 
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cally  identified  •  when  the  desired  outcome  (or 
response)  is  physical  performance.  Moreover,  iden¬ 
tifying  the  minimal  dose-response  relationships,  not 
to  mention  truly  testable  metrics  or  standards,  has 
proven  the  greatest  challenge. 

An  overview  of  the  limited  attempts  thus  far 
applied  for  this  type  of  approach  to  the  process  of 
physical  fitness  standards  development  is  also 
given.  A  novel  analysis  by  the  Institute  for 
Aerobics  Research  initially  suggests  the  car- 
diorespiritory  cut-points  might  be  relatively  low.  A 
much  clearer  relationship  has  been  identified 
between  body  composition  (e.g.,  body  mass  index 
[BMI]  correlates  with  fatness  and  is  defined  by 
weight  [kilograms]  divided  by  the  square  of  the 
height  [meters])  and  health.  While,  the  muscu¬ 
loskeletal  fitness  modality  should  prove  to  be  the 
most  difficult  relationship  to  correlate  with  per¬ 
sonal  health.  Therefore,  however  attractive  or  mer¬ 
itorious  this  endeavor  may  appear,  the  basic  obser¬ 
vation  should  be  that  in  application  or  practice, 
varying  levels  of  difficulty  may  be  encountered, 
again  depending  on  the  chosen  modality.  This  is 
primarily  due  to  the  general  lack  of  sufficient  data 
and/or  discreet  methodologies  to  identify  clearly 
defined  cut-points  to  base  standards  on. 
Nevertheless,  this  should  not  deter  further  efforts 
to  apply  or  investigate  alternative  procedures. 
Overall,  Chapter  2  of  the  SOAR  explores  the  con¬ 
cept  of  baseline,  health  related  fitness  require¬ 
ments  with  potential  application  to  selected  mili¬ 
tary  and  civilian  environments.  Also  presented  is 
the  theoretical  merit  for  this  more  “generic” 
approach  to  the  process  of  physical  fitness  stan¬ 
dards  development  and  available  methodological 
procedures  and  precedents,  e 


Flexible  tools  for  human  factors 
and  ergonomics  research 


•  The  Observer®  -  Professional  system  for  collection,  analysis  and 
management  of  observational  data.  For  desktop  or  mobile  data 
entry,  live'  or  from  video. 


Observational  labs  -  Tailor-made  systems  for 
observational  research  or  usability  tests.  Mobile, 
semi-portable  and  stationary  designs  available. 


Sterling,  VA,  U.S.A. 
Phone:+1-703-404-5506 
Toll-free:  1-800-355-9541 
E-mail:  info@noldus.com 


Wageningen, 
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Phone:  +31-317-497677 
E-mail:  info@noldus.nl 

Freiburg,  Germany 
Phone:  +49-761-4701600 
E-mail:  info@noldus.de 


Noldus 

INFORMATION  TECHNOLOGY 


The  Human  Systems  Information  Analysis 
Center  (Human  Systems  IAC)  is  the  gateway  to 
worldwide  sources  of  up-to-date  human  sys¬ 
tems  information  for  designers,  engineers, 
researchers,  and  human  factors  specialists. 

HSIAC’s  primary  objective  is  to  acquire,  ana¬ 
lyze,  and  disseminate  timely  information  about 
human  systems/ergonomics.  The  Human  sys¬ 
tems  IAC  offers  five  levels  of  user  service: 

•  Basic  Inquiry 

•  Search  &  Summary 

•  Review  &  Analysis 

•  Technical  Area  Task 

•  Meeting  Administration 


The  Basic  Inquiry  offers  limited  technical  service  at 
no  cost  to  the  user  to  clarify  and  respond  to  a  spe¬ 
cific  inquiry.  Basic  Inquires  can  be  requested  by 
contacting  the  Human  Systems  IAC  Program  Office: 

Phone:  (937)  255-2450 
Fax:  (937)  255-4823 

E-mail:  paul.cunningham2@wpafb.af.mil 

Cost  for  other  services  are  based  on  the  techni¬ 
cal  nature  and  time  involved.  For  information 
on  products  go  to: 

http://iac.dtic.mil/hsiac/products/pstoc.html 
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Baltimore,  MD,  USA.  March  12-14,  2002 

HE  Applied  Ergonomics  Conference 

URL:  http://acob.com/IIE/re  erao2002.html 


Cleveland,  OH,  USA.  March  26-28,  2002 

Ohio  Safety  Congress  and  Expo 

Tel.  +1-800-OHIOBWC,  press  22,  then  3,  URL:  http://www.ohiobwc.com 


Orlando,  FL,  USA.  April  1-5,  2002 

The  SPIE  Aerosense/Defense  Symposium 

Tel.;  +1-360-676-3290,  Fax  +1-360-647-1445,  E-mail:  spie@spie.org, 
URL:  http://spie.ora/Conferences/Calls/02/or/lnvite.html 


Cambridge,  UK.  April  3-5,  2002 

The  Ergonomics  Society  2002  Annual  Conference 

URL:  http://www.eroonomics.ora.uk/events/confcall02.htm 

San  Diego,  CA,  USA.  April  7,  2002  (Preconference  Workshops  April  8-10,  2002) 

Simulation  Solutions  2002  Conference 

Contact:  Jack  Eller,  Tel.  +1-770-449-0461,  ext  109,  Fax:  +1-770-263-8532, 

E-mail:  jeller@iienet.org,  URL:  http://www.simsol.org/ 


A  Coruna,  Spain.  April  15-18,  2002  . 

Human  Factors  and  Medicine  Panel  Symposium.  On  Spatial  Disorientation  in  Military  Vehicles; 
Causes,  Consequences  and  Cures 

Tel:  +33-15561-2262,  Fax:  +33-15561-2298.  Open  to  Partners  for  Peace  (PfP)  nations 


Minneapolis,  MN,  USA.  April  20-25,  2002 

CHI  2002  Conference  on  Human  Factors  in  Computing  Systems 

Contact:  CHI  2002  Office,  703  Giddings  Avenue,  Suite  U-3,  Annapolis,  MD  21401,  USA. 
Tel:  +1-401-263-5382,  Fax:  +1-410-267-0332,  E-mail:  CHI2002-office@acm.org, 

URL:  http://www.acm.org/siachi/chi2002 


San  Diego,  CA,  USA.  April  29  -  May  2,  2002 

47"'  Meeting  of  the  DoD  Human  Factors  Engineering  Technical  Advisory  Group 

Contact:  Ms.  Sheryl  Cosing,  10822  Crippen  Vale  Court,  Reston,  VA  20194, 

Tel.  +1-703-925-9791,  Fax.  +1-703-925-9694,  E-mail:  sherylynn@aol.com 
URL:  http://dtica.dtic.mil/hftaa/meetschl.html 


Orlando,  FL,  USA.  May  19-22,  2002 

HE  Annual  Conference  2002 

Contact:  Institute  of  Industrial  Engineers,  25  Technology  Park,  Norcross,  GA  30092 
Tel.  +1-800-494-0460  or  +1-770-449-0460,  Fax:  +1-770-441-3295, 

URL:  http://1 28.241 .229.4/oublic/articles/index.cfm?Cat=265 

Boston,  MA,  USA.  May  19-24,  2002 

SID  2002:  Society  for  Information  Display 

Contac:  SID,  do  Palisades  Institute  for  Research  Services,  Inc.,  411  Lafayette  Street,  2nd  Floor, 
New  York,  NY  10003,  USA.  Tel:+1-21 2-460-8090,  Fax:  +1-212-460-5460, 

E-mail:  wklein@palisades.org,  URL:  http://www.sid.org 
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San  Jose,  CA,  USA.  June  2002 

ErgoCon  2002  Silicon  Valley  Ergonomics  Conference  and  Exposition 

Contact  Silicon  Valley  Ergonomics  Institute,  San  Jose  State  University,  One  Washington  Square, 
San  Jose,  CA  95192-0180  USA,  Tel  +1-408-924-4132, 

Fax:  +1-408-924-4040,  E-mail:  ergocon@email.sjsu.edu, 

URL:  http://www.enar.sisu.edu/eraocon 


jun 


Toronto,  Canada.  June  10-13,  2002 

XVI  Internationa!  Annua!  Occupational  Ergonomics  &  Safety  Conference 

Contact:  Dr.  Sourin  P.  Dutta,  Conference  Chair,  ISOES  Annual  Conference  2002,  Department  of 
Industrial  and  Manufacturing  Systems  Engineering,  University  of  Windsor,  Windsor,  Ontario, 
N9B3P4  Canada.  Tel.  +1-519-253-3000,  ext.  2608, 

Fax:  +1-519-973-7062,  E-mail:  sdutta@uwindsor.caisoes@uwindsor.ca, 

URL:  http://www.uwindsor.ca/isoes 


Munich,  Germany.  June  18-20,  2002 

SAE  Digital  Human  Modeling  for  Design  ant!  Engineering  (DHhII 

Forum  Hotel.  URL:  http://www.sae.ora/calendar/dhm/index.htm 


\ 


Orlando,  FL,  USA.  July  8-12,  2002 

11 Annua'  UPA  Conference 

Contact:  UPA  Conference  Office,  Prestige  Accommodations,  1518  Brookhollow  Drive,  Suite  23, 
Santa  Ana,  CA  92705  USA.  Tel.  +1-800-321-6338  or +1-714-957-9100, 

E-mail :  registration  @  prestigeacc.com, 

URL:  http://www.riahiinterface.com/upatestsite/conf  upa2002.htm 


iul 


Elephant  and  Castle,  London,  UK.  September  2-6,  2002 

The  16'"  British  HC1  Group  Annual  Conference  Incorporating  Eurcpse 
Association  Conference  2G32 

URL:  http://cise.sbu.ac.uk/hci2002/index.html 


Usability  Professionals’ 


sep 


Pisa,  Italy.  September  18-20, 2002 

Fourth  International  Symposium  on  Human  Comp 

URL:  http://aiove.cnuce.cnr.it/mobilehci02.html 


liter  Interaction  with  Mobile  Devices 


\ 

Pittsburgh,  PA,  USA.  September  23-27,  2002 

HFES  45'"  Annual  Meeting 

Pittsburgh  Hilton  and  Towers.  Contact:  HFES  Office  P.O.  Box  1369,  Santa  Monica,  CA  90406-1369 
USA.  Tel:  +1  310-394-1811,  Fax  +1  310-394-2410,  URL:  http://hfes.org 


San  Diego,  CA,  USA.  October  7-9,  2002 

20'"  Annua!  Congress  &  Expo 

Contact:  National  Safety  Council,  1121  Spring  Lake  Drive,  Itasca,  IL  60143-3201  USA. 
Tel.  +1-630-285-1121,  Fax:  +1-630-285-1315,  URL:  http://www.nsc.ora/expo02\call.htm 


oct 


MIT,  Cambridge,  MA,  USA.  October  23-25,  2002 

HCI-Aero  Human-Computer  Interaction  in  Aeronautics 

Contact:  HCI-Aero  2002  Office,  European  Institute  of  Cognitive  Sciences  and  Engineering 
(EURISCO),  4  Avenue  Edouard  Belin,  31400  Toulouse,  France.  Tel:  +33  (0)  5  62  17  38  38, 
Fax:  +33  (0)  5  62  17  38  39,  E-mail:  hci-aero2002@onecert.fr, 

URL:  http://www-eurisco.onecert.fr/events/hci-aero2002.html/ 
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Job  Analysis 


Figure  1.  Mark  Rayson  measures  oxygen  uptake  (luring  simulated 
loaded  marching  in  army  soldiers. 


For  further  information, 
please  contact: 

Mark  Rayson,  Ph.D. 
Optimal  Performance 
Limited 
Old  Chambers 
93/94  West  Street 
Farnham 
Surrey  GU97EB 
United  Kingdom 

mark@optimalperfor- 

mance.co.uk 


llSplM  he  purpose  of  conducting  a 
H  job  analysis  or  Physical 
m  Demands  Analysis  is  to 
describe  and  quantify  those  aspects 
of  physical  fitness  or  physical  per¬ 
formance  that  are  relevant  to  job  per¬ 
formance.  Given  the  interdependen¬ 
cies  between  aspects  of  the  job,  the 
environment,  and  the  employees, 
adopting  a  systems  approach  is 
essential  in  documenting  and  quanti¬ 
fying  these  elements.  Job  or  task  ele¬ 
ments  include  mode,  frequency, 
intensity  and  duration  of  a  task,  pos¬ 
tures,  objects,  and  equipment  used. 
Environmental  factors  include  tem¬ 
perature,  humidity,  altitude,  noise, 
air  pollution,  workspace,  clothing 
etc.  The  human  elements  include 
age,  gender,  body  dimensions,  for 
example.  Conducting  a  job  analysis 
should  be  an  employer's  first  step  to 
improve  the  integration  of  the  human 
element  into  the  system. 

A  number  of  techniques  have  been 
presented  to  identify  the  most  physi¬ 
cally  demanding  tasks  using  some 
industrial/organizational  psychology 
tools,  such  as  observation,  interviews 
and  questionnaires.  Other  techniques 
for  quantifying  the  stress  and  strain 
associated  with  these  tasks  using 
physiological,  biomechanical  and 
psychophysical  approaches  are  pre¬ 
sented,  and  the  strengths  and  limita¬ 
tions  of  the  various  approaches  are 
discussed.  In  brief,  the  physiological 
approach  appraises  the  strain  on  the 
cardiovascular  and  respiratory  sys¬ 
tems  through  the  measurement  of 
responses  such  as  heart  rate,  oxygen 
uptake  rate  or  lactate  accumulation 
(see  Figure  1).  The  biomechanical 


Mark  Rayson 

Optimal  Performance  Limited 


approach  scrutinizes  the  forces  exerted  on  and 
by  the  body  during  work.  It  is  often  used  to 
analyze  postures  and  the  support  and  move¬ 
ment  of  loads  and  is  therefore  particularly  use¬ 
ful  in  assessing  material  handling  tasks.  The 
psychophysical  approach  assumes  that  both 
biomechanical  and  physiological  stresses 
impinge  on  an  employee  performing  any  task 
and  that  these  stresses  are  integrated  and  com¬ 
bined  and  can  be  assessed  as  an  objective 
measure  of  acceptable  demand  rate  of  repeti¬ 
tive  work  or  perceived  stress. 

The  issue  of  which  approaches  and  tech¬ 
niques  should  be  selected  by  the  investigator 
will  depend  on  many  factors,  including  the 
nature  of  the  job  or  task  under  investigation, 
the  extent  of  financial  and  human  resources 
available  to  support  the  work,  and  the  expertise 
of  the  investigation  team.  In  general  terms,  a 
multidisciplinary  approach  performed  by  a 
multi-ethnic,  mixed-gender  and  -aged  team  with 
differing  skills  and  perspectives  is  preferred,  as 
it  is  more  likely  to  elicit  a  complete  and  bal¬ 
anced  output.  The  optimal  team  is  also  likely  to 
comprise  both  in-house  workers  who  are  highly 
familiar  with  the  jobs  under  scrutiny,  and  exter¬ 
nal  consultants  who  can  bring  greater  objectiv¬ 
ity  and  reliability  to  the  process. 

In  conclusion,  this  chapter  presents  the  mer¬ 
its  of  numerous  approaches  for  conducting  a 
job  analysis  to  identify  and  quantify  the  most 
demanding  tasks.  While  conducting  a  job 
analysis  is  a  complex  process  requiring  time, 
money,  effort,  and  equal  measure  of  good  sci¬ 
ence  and  good  judgment,  the  results  provide  a 
solid  foundation  for  establishing  occupational 
fitness  standards,  focusing  physical  training 
programs,  identifying  health  and  safety  issues, 
and  prioritizing  those  tasks  that  require  job 
redesign.  The  long-term  benefit  to  the  employ¬ 
er  of  implementing  these  strategies  will  be 
increased  productivity  through  improved  oper¬ 
ational  effectiveness  and  reduced  injury,  w 
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IE^pI;here  are  two  general  types  of  tests  used  to 

(evaluate  a  person's  ability  to  do  physically 
demanding  work  tasks.  These  are  work 
sample  and  basic  ability  tests.  Work  sample  tests 
are  designed  to  duplicate  occupational  tasks. 
Physical  ability  tests  measure  common  physiologi¬ 
cal  constructs  that  include  aerobic  fitness 
(V02max),  body  composition,  strength,  muscle 
endurance,  balance  and  flexibility. 

The  principle  advantage  of  work  sample  tests  for 
making  employment  decisions  is  they  tend  to  be  con¬ 
tent  valid.  The  closer  that  the  work  sample  test  dupli¬ 
cates  an  important  work  task,  the  more  likely  that  the 
test  is  content  valid.  While  work  sample  tests  are 
commonly  used  to  make  employment  decisions  they 
do  have  limitations.  In  some  instances,  work  sample 
tests  are  expensive  to  create,  difficult  to  set  up  and 
transport  from  one  location  to  another.  Another  dis¬ 
advantage  is  that  work  sample  tests  are  often  scored 
by  pass  or  fail  and  does  not  give  information  about 
an  individual's  maximum  work  capacity.  While  two 
applicants  may  both  pass  a  work  sample  test,  one 
may  have  the  physiological  capacity  to  do  the  work 
while  the  other  may  be  working  close  to  their  physi¬ 
ological  capacity.  A  final  limitation  is  the  risk  of 
injury  is  increased  for  applicants  who  lack  the  phys¬ 
ical  capacity  to  meet  the  demands  of  the  task,  but  try 
their  best  to  pass  the  test.  The  major  limitation  of 
basic  ability  tests  is  that  the  test  measures  the  appli¬ 
cants  physiological  capacity;  it  does  not  duplicate  the 
work  task.  To  validly  use  a  basic  ability  test  to  make 
an  employment  decision,  the  researcher  would  need 
to  establish  two  interrelated  conditions.  First  that  the 
work  task  is  correlated  with  the  basic  ability.  Second, 
the  level  of  the  basic  ability  required  to  perform  the 
task.  As  an  illustration,  it  is  well  established  that  the 
capacity  to  lift  materials  (e.g.,  box)  from  floor-to- 
kunckle  height  is  a  function  of  the  lifter's  strength, 
but  the  load  that  needs  to  be  lifted  can  vary.  The 
strength  needed  to  lift  a  75-pound  load  will  be  greater 
than  the  strength  required  for  a  50-pound  lift. 

Research  confirms  that  physically  demanding  work 
tasks  are  largely  dependent  on  the  basic  abilities  of 


aerobic  fitness  (V02max),  body  composi¬ 
tion,  and  strength.  The  work  tasks 
dependent  upon  aerobic  fitness  are  those 
that  require  the  worker  to  move  their 
body  weight  (e.g.,  climbing  stairs)  and 
work  for  extended  periods  of  time.  A 
major  focus  of  occupational  aerobic  fit¬ 
ness  research  has  been  to  define  the  phys¬ 
iological  capacity  needed  to  be  a  firefight¬ 
er.  Laboratory  research  has  shown  that  a 
V02max  of  33.5  ml/kg/min  is  the  mini¬ 
mum  aerobic  fitness  one  must  have  to 
meet  the  demands  of  firefighting.  The 
capacity  to  perform  many  different  physi¬ 
cally  demanding  work  tasks  is  dependent 
of  body  composition.  Percent  body  fat  is 
correlated  with  work  tasks  that  require 
the  individual  to  move  their  body. 
Individuals  with  a  high  level  of  body  fat 
have  more  difficulty  with  body  movement 
tasks  such  as  climbing.  Fat-free  mass  is 
the  source  of  the  body’s  capacity  to  gen¬ 
erate  force.  Research  shows  that  the 
capacity  to  do  strength-related  work  tasks 
are  dependent  upon  the  body’s  fat-free 
weight  component.  Because  of  an 
increased  threat  of  litigation,  body  com¬ 
position  variables  are  rarely  used  for  pre¬ 
employment  testing  in  the  public  sector.  A 
wide  variety  of  work  tasks  have  been 
shown  to  be  correlated  with  muscular 
strength.  While  strength  can  be  measured 
by  isokinetic,  isotonic  or  isometric  meth¬ 
ods,  the  principle  method  used  for  pre¬ 
employment  testing  is  with  isometric 
strength  tests.  Isometric  strength  tests 
have  been  shown  to  be  correlated  (r  3 
0.63)  with  many  different  force  genera¬ 
tion  and  absolute  endurance  work  tasks. 
The  capacity  to  generate  push,  pull  and 
lift  force  in  a  variety  of  body  positions  is 
dependent  upon  strength.  Absolute 
endurance  work  tasks  are  those  that  the 
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For  further  information, 
please  contact: 

Andrew  S.  Jackson,  P.E.D. 
Department  of  Health  and 
Human  Performance 
University  of  Houston 
Houston,  TX  77004 

Ajackson@mail.uh.edu 

power-output  is  the  same  for 
all  workers.  Examples  of  these 
tasks  are  opening  and  closing 
valves,  shoveling  and  trans¬ 
porting  heavy  objects. 
Materials  lifting,  one  of  the 
more  common  industrial 
tasks,  is  dependent  on  the 
worker’s  strength.  Although 
important,  the  basic  abilities  of 
flexibility,  balance,  and  agility 
are  less  likely  to  be  related  to 
physically  demanding  tasks,  m 
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For  further  information,  ii|plhe  principal  guidance  for  the  Environmental  Conditions,  Workforce  Numbers, 

please  contact:  HBj  anc[  implementation  0f  Criticality  of  the  Job,  Workforce  Productivity. 

I  selection  tests  for  employment  is  It  is  required  by  the  Uniform  Guidelines  that 
James  A.  Hodgdon,  Ph.D.  the  Uniform  Guidelines  on  employee  validity  studies  be  conducted  whenever  it  is  nec- 

Human  Performance  Center  Selection  Procedures  issued  by  the  Equal  essary  to  continue  selecting  practices  that  lead  to 

Naval  Health  Research  Employment  Opportunity  commission  in  adverse  impacts.  All  studies  must  be  carried  out  in 

Center  1978  (EEOC,  1978).  The  sanctioned  vali-  a  responsible  manner  and  require  using  good  judg- 

P.O.  Box  85122  dation  methods  are  criterion-related  ment  in  implementing  selection  procedures.  ■ 

San  Diego,  CA  92186-5122  validity,  content  validity,  and  construct 

validity  (see  Tables  1,  2,  and  3). 

hodgdon@ngrc.navy.mil  Content  validity  indicates  the  test 

items  reflect  elements  of  the  job.  The 
Andrew  S.  Jackson,  P.E.D.  job  and  test  content  are  linked. 

Department  of  Health  and  Criterion-related  validity  indicates  the 

Human  Performance  test  items  are  proven  to  be  estimators  or 

University  of  Houston  predictors  of  critical  or  important 

Houston,  TX  77004  duties,  work  behaviors  or  work  out¬ 

comes.  Construct  validity  is  present 
Ajackson@mail.uh.edu  when  selection  tests  are  related  to  a 

general  trait  or  set  of  characteristics 
associated  with  successful  accomplish- 
Reference  ment  of  critical  job  behaviors. 

EEOC.  (1978).  Uniform  The  measurement  theory  used  to 

guidelines  on  employment  evaluate  the  quality  of  employment 

selection  procedures.  tests  is  based  on  the  American 

Federal  Registers ,  43  Psychological  Association  standards  for 

(38289-28309).  validating  educational  and  psychologi¬ 

cal  tests  (A.P.A,  1985;  A.P.A,  1987).  A 
major  difference  in  physical  test  valida¬ 
tion  is  the  use  of  physiological  rather 
than  psychological  tests.  The  goal  of 
physiological  validation  is  to  define  the 
physiological  capacity  needed  by  a 
worker  to  perform  the  work  demanded 
by  the  task.  Principal  features  of  the 
physiological  validation  approach  are 
the  use  of  a  physiological  metric  to 
quantify  test  performance  and  the  inter¬ 
pretation  of  validity  results  with  rele¬ 
vant  physiological  research  and  theory. 

In  physiological  validation,  the  goal  is 
to  match  the  worker  with  the  physio¬ 
logical  demands  of  the  job.  Many  fac¬ 
tors  are  considered:  Adverse  Impact, 

Risk  of  Injury,  Physiological 
Interpretation  of  the  Validation  Results, 
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Table  1 .  EEOC  Technical  standards  guidelines  for  the 
criterion  validation  method. 


1.  The  study  must  be  technically  feasible.  It  must  be  pos¬ 
sible  to  get  an  adequate  sample  size  to  provide  a  scien¬ 
tifically  sound  result.  However,  an  employer  is  not 
required  to  hire  or  promote  individuals  in  order  to  be 
able  to  conduct  a  criterion -related  study. 

2.  Whether  the  study  is  to  be  concurrent  or  predictive,  the 
sample  subjects  should  be  representative  of  the  individ¬ 
uals  who  might  reasonably  be  expected  to  fill  the  posi¬ 
tions  being  studied. 

3.  In  general,  the  guidelines  indicate  the  finding  of  a  signif¬ 
icance  level  P  <  0.05  to  be  acceptable. 

4.  However,  users  should  evaluate  each  selection  proce¬ 
dure  to  assure  that  it  is  appropriate  for  operational  use. 
In  general,  the  greater  the  magnitude  of  the  correlations 
found  between  the  job  behaviors  and  the  tests,  and  the 
greater  the  number  of  job  behaviors  predicted  by  a  par¬ 
ticular  test,  the  more  appropriate  it  is  for  implementa¬ 
tion.  Selection  procedures  derived  from  studies  with 
large  sample  sizes  and  low  correlations,  and  sole 
reliance  on  a  selection  instrument  that  is  related  to  only 
one  of  many  critical  job  behaviors  will  be  subject  to 
close  review. 

5.  Users  must  avoid  use  of  techniques  that  can  lead  to 
inflated  validities  for  selection  procedures.  Examples 
include  reliance  on  a  few  selection  procedures  or  crite¬ 
ria  when  many  were  studied,  and  use  of  the  statistics 
from  one  sample  when  they  may  not  have  held  up  well 
on  cross-validation.  The  Guidelines  recommend  large 
samples  and  use  of  cross-validation. 

6.  The  Guidelines  call  for  the  maintenance  of  "fairness"  in 
selection  procedures.  Essentially,  unfairness  results 
when  members  of  one  group  characteristically  obtain 
lower  scores  on  a  selection  procedure  than  members  of 
another  group,  but  the  differences  in  scores  on  the 
selection  instrument  are  not  manifest  in  differences  in 
job  performance.  The  guidelines  call  for  investigation  of 
the  fairness  of  selection  procedures  whenever  a  selec¬ 
tion  device  has  adverse  impact. 


.Table  2r  EEOC  Technical  standards  guidelines  for  the 
content  validation  method. 


Technical  Standard  for  Content  Validation  Studies 


1 .  Consideration  must  be  given  to  the  appropriateness  of 
content  validity  strategy.  Such  a  strategy  is  not  appro¬ 
priate  when  the  job  tasks  represent  knowledge,  skills, 
and  abilities  that  an  employee  is  expected  to  learn  on 
the  job.  It  is  also  not  appropriate  for  demonstrating  the 
validity  of  selection  procedures  that  claim  to  measure 
traits  or  constructs  such  as  intelligence,  aptitude,  per¬ 
sonality,  common  sense,  judgment,  and  leadership. 

2.  The  job  analysis  must  focus  on  the  important  work 
behaviors,  their  relative  importance  across  all  behav¬ 
iors,  and  the  products  of  such  work  behaviors.  To  be 
included  in  a  work  sample,  the  behaviors  must  be 
observable,  and  some  aspect  of  them  must  be  measur¬ 
able.  The  work  behaviors  selected  for  measurement 
should  be  critical  and/or  important  work  behaviors  that 
constitute  most  of  the  job. 

3.  To  demonstrate  content  validity  of  a  selection  proce¬ 
dure,  it  must  be  shown  that  the  behaviors  are  a  repre¬ 
sentative  sample  of  behaviors  of  the  job  or  that  the 
selection  procedure  offers  a  representative  sample  of 
the  work  product  of  the  job.  For  selection  procedures 
measuring  a  skill  or  ability,  the  procedures  must  closely 
approximate  an  observable  work  behavior  or  work 
product.  The  closer  the  content  and  the  context  of  the 
selection  tests  are  to  work  samples  and  work  behaviors, 
the  more  suitable  they  are  for  showing  content  validity. 

4.  Whenever  feasible,  measurement  of  the  reliability  of  the 
selection  procedures  should  be  carried  out. 


Table  3.  EEOC  Technical  standards  guidelines  for  the 
construct  validation  method. 


Technical  Standard  for  Construct  Validity  Studies 


1 .  The  Guidelines  recognize  that  establishment  of  con¬ 
struct  validity  is  a  more  complex  strategy  than  either 
content  or  criterion -related  validity,  and  that  there  was, 
at  the  time  of  Guidelines’  publication,  a  lack  of  literature 
extending  the  concept  to  employment  practices. 

2.  Therefore,  the  job  analysis  must  be  carried  out  in  a 
fashion  that  allows  the  identification  of  constructs 
underlying  the  important  job  behaviors.  Each  construct 
discovered  should  be  named  and  defined  to  distinguish 
it  from  all  other  constructs  so  discovered. 


3.  Selection  procedures  should  then  be  developed  or  iden¬ 
tified  that  measure  the  work  behavior  constructs.  The 
users  must  then  show  that  the  selection  procedures  are 
related  to  the  work  behavior  constructs  and  that  the 
work  behavior  constructs  are  validly  related  to  the  per¬ 
formance  of  important  or  critical  work  behaviors. 

4.  The  Guidelines  allow  limited  use  of  construct  validity 
studies.  “Until  such  time  as  professional  literature  pro¬ 
vides  more  guidance  on  the  use  of  construct  validity  in 
employment  situations,  the  Federal  agencies  will  accept 
a  claim  of  construct  validity  without  a  criterion-related 
study... only  when  the  selection  procedure  has  been 
used  elsewhere  in  a  situation  in  which  a  criterion-related 
study  has  been  conducted  and  the  use  of  a  criterion- 
related  validity  study  in  this  context  meets  the  stan¬ 
dards  for  transportability  of  criterion-related  validity 
studies  set  forth  above....” 


products 

tAC 


If  you  have  any  questions  concerning  this  product  list, 
please  access  our  web  page  http://iac.dtic.mil/hsiac  or  contact 
Lisa  McIntosh  at:  Tel:  (937)  255-4842,  DSN:  785-4842, 

Fax:  (937)  255-4823. 


Product 


Unit  Price 


50  Years  of  Human  Engineering  Book 


N/C 


50  Years  of  Human  Engineering  CD 


$35® 


Anthropometric  Data  Analysis  Sets  (ADA) 


$100® 


Application  of  Human  Performance  Models  to  System  Design 


$60® 


Biological  Psychology  Special  Issue 


$25°° 


CASHE:  PVS  Software  for  MAC  Computers 


$395® 


Colloquium  Videotapes 


$25® 


Color  in  Electronic  Displays 


$45® 


Electronic  Imaging  Proceedings 


N/C 


Engineering  Data  Compendium  Including  User’s  Guide 


$295® 


Engineering  Data  Compendium  User’s  Guide  ONLY 


$65“ 


Future  Metrics  and  Models 


$25“ 


HSIAC  Gateway  Newsletter 


N/C 


Human  Factors  Definitions 


N/C 


NASA  TLX  Paper  and  Pencil  Version 


$20® 


NASA  TLX  Computer  Version  (DOS  Version) 


$20® 


NAS/NRC  Human  Factors  Survey 


$25® 


Perception  and  Control  of  Self  Motion 


$29Si 


SOAR 

Analysis  Techniques  for  Human— Machine  System  Design 

$45“ 

SOAR 

Behind  Human  Error 

$39“ 

SOAR 

Computational  Models  of  Human  Performance 

$39“ 

SOAR 

Human  Factors  Engineering  in  System  Design 

$35“ 

SOAR 

Hypertext 

$35® 

SOAR 

Improving  Function  Allocation 

$39® 

SOAR 

Naturalistic  Decision  Making 

$35® 

SOAR 

Process  of  Physical  Fitness  Standards 

$45® 

SOAR 

Situational  Awareness  in  the  Tactical  Air  Environment 

$45® 

SOAR 

Strategic  Workload 

$35“ 

SOAR 

The  Book  of  HUD 

$35“ 

SOAR 

Three-Dimensional  Displays 

$35“ 

SOAR 

The  Process  of  Physical  Fitness  Standards  Development 

$45“ 

SWAT  (DOS  Version) 

$50® 
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Deborah  L.  Gebhardt,  Pli.D. 
Human  Performance  Systems,  Inc. 


For  further  information 
please  contact: 

Deborah  L.  Gebhardt,  Ph.D. 
Human  Performance 
Systems,  Inc. 

5000  Sunnyside  Avenue 
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Reference 

Equal  Employment 
Opportunity  Commission, 
Civil  Service  Commission, 
Department  of  Labor;  Title 
29  Code  Of  Federal 
Regulations  Part  1607 — 
"Uniform  Guidelines  On 
Employee  Selection 
Procedures  (1978)” 


::  n  the  employment  setting,  test  scores 

'  may  be  used  to  determine  and  pre- 
diet  acceptable  job  performance. 
Identification  of  the  test  score(s)  that 
predicts  whether  a  job  candidate  can 
perform  or  be  trained  to  perform  the 
essential  job  tasks  is  crucial  to  the  selec¬ 
tion  of  qualified  workers.  Several 
methodologies  can  be  used  to  establish 
passing  scores  for  tests.The  methodolo¬ 
gy  employed  depends  upon  the  type  of 
validity  strategy  used  in  the  validation 
study.  Typically  content  and  criterion- 
related  validity  are  used. 

The  requirements  for  identifying  pass¬ 
ing  scores  are  addressed.  These  are 
referred  to  by  a  variety  of  names  such  as 
minimum  test  score,  cutoff  score,  cut- 
score,  performance  standard,  and  pass¬ 
ing  score.  The  term  passing  score  is  used 
to  refer  to  a  test  score  that  is  indicative 
of  acceptable  test  performance. 

To  establish  a  job-related  passing 
score  that  identifies  successful  and 
unsuccessful  candidates,  accurate  test 
(predictor),  job  performance  (criterion), 
and  ergonomic/physiological  data  are 
needed.  Criterion  measures  assess  dif¬ 
ferent  levels  of  job  performance  and  are 
coupled  with  test  scores  and  validity 
coefficients  to  determine  a  passing 
score.  These  components  are  also  used 
to  assess  whether  the  passing  score 
maximizes  the  correct  hiring  decisions 
and  minimizes  testing  errors.This  is 
accomplished  through  the  use 
expectancy  tables,  contingency  tables, 
and  Taylor  Russell  tables  [According  to 
Taylor  and  Russell,  there  are  three 
important  factors  to  consider  when 
judging  the  validity  of  a  selection  test: 
(a)  the  correlation  between  the  test 
score  and  job  performance,  (b)  the  base 
rate  of  success  on  the  job,  and  (c)  the 
selection  ratio]  .The  use  of  ergonomic, 
physiological,  and  normative  data  for 


setting  standards  is  also  discussed  in  relation  to 
identifying  an  accurate  passing  score. 

Issues  related  to  test  fairness  and  adverse 
impact,  and  their  integration  with  legal  require¬ 
ments  are  highlighted.  The  impact  of  basic  physio¬ 
logical  tests  (e.g.,  aerobic  capacity,  strength  test) 
and  job  simulations  on  the  reduction  of  adverse 
impact  is  addressed  by  using  comparisons  from  a 
variety  of  physical  performance  validity  studies. 
Finally,  the  computation  of  test  fairness  is 
described,  along  with  its  relationship  to  adverse 
impact  and  test  utility. 

Table  1  shows  an  example  of  a  graphic  rating 
scale  used  in  a  validation  study  to  assess  selected 
aspects  of  job  performance  (criterion  measure)  for 
use  in  deriving  the  validity  coefficient  in  a  criteri¬ 
on-related  validity  study  and  to  determine  whether 
a  specific  test  score  accurately  identified  individu¬ 
als  whose  job  performance  was  acceptable.  The 
integration  of  data  from  multiple  sources  (e.g.,  test 
score,  criterion  measures,  ergonomic,  physiologi¬ 
cal,  hiring  ratios)  is  used  in  conjunction  with 
expectance  table,  contingency  table,  and  Taylor 
Russell  tables  to  establish  an  accurate  passing  score 
that  will  reflect  future  job  performance.  Finally, 
these  data  are  combined  with  issues  such  as  test 
fairness  and  adverse  impact  to  ensure  accurate 
employment  decision  and  compliance  with  EEOC 
Uniform  Guidelines  on  Employee  Selection 
Procedures  (1978).  ■ 

Table  1.  Graphic  rating  scale  examples 

Scale  1 

5  =  Above  average 

4  =  Slightly  above  average 

3  =  Average 

2  =  Below  average 

1  =  Poor 

Scale  2 

5  =  Greatly  exceeds  job  requirements 

4  =  Exceeds  job  requirements 

3  =  Meets  job  requirements 

2  =  Meets  minimal  job  requirements,  with  assistance 

1  =  Does  not  meet  job  requirements 
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Illpllitle  VII  of  the  Civil  Rights  Act  of  1964,  the 
I  ;j  Age  Discrimination  in  Employment  Act 
!i  (ADEA)  of  1967,  and  Americans  with 
Disabilities  Act  (ADA)  of  1990,  are  the  federal  laws 
that  define  discriminatory  employment  practices. 
The  centerpiece  of  employment  discrimination  law 
is  Title  VII  of  the  Civil  Rights  Act  of  1964,  as  amend¬ 
ed  by  Congress  on  several  occasions.  Title  VII  pro¬ 
hibits  employment  discrimination  because  of  “race, 
color,  religion,  sex,  and  national  origin”  by  employ¬ 
ers,  labor  organizations,  and  employment  agencies. 
Title  VII  tends  to  be  comprehensive  in  that  everyone 
is  potentially  covered,  because  both  genders  and  all 
majority  and  minority  racial  and  ethnic  groups,  as 
well  as  religious  groups,  are  covered  by  Title  VII, 
but  the  act  does  not  apply  to  Military  personnel. 

In  determining  whether  applicants  are  capable 
of  performing  required  job  tasks  has  been  the  main 
force  behind  a  multitude  of  tests  used  by  employ¬ 
ers  to  predict  job  performance.  When  physical 
tests  are  used  to  determine  employment  a  compa¬ 
ny  must  be  very  careful  to  judge  that  the  test  is 
valid,  necessary  for  the  job  at  hand,  and  does  not 
discriminate  against  a  protected  group. 

The  disparate  impact  theory  is  used  to  establish 
employment  discrimination.  This  legal  process  has 
a  three-part  burden  of  proof.  First,  the  plaintiff 
(employee)  must  establish  that  the  hiring  practice 
has  a  disparate  impact  on  a  protected  group. 
Although  not  legally  mandated,  the  Equal 
Employment  Opportunity  Commission  (EEOC) 
Guidelines  are  often  used  to  define  disparate 
impact.  The  guidelines  use  the  four-fifths  (4/5s) 
rule  to  define  adverse  impact.  Under  the  4/5s  rule 
a  selection  device  has  adverse  impact  when  the 
pass  rate  for  one  protected  group  is  less  than  four- 
fifths,  or  80  percent,  of  the  pass  rate  of  the  group 
with  the  highest  pass  rate.  Once  adverse  impact  is 
established,  the  burden  of  proof  then  falls  on  the 
defendant  (employer)  to  justify  that  the  exclusion¬ 
ary  effect  is  a  business  necessity.  The  defendant 
must  show  that  the  selection  method  is  job  relat¬ 
ed.  This  involves  demonstrating  that  the  selection 
device  (e.g.,  preemployment  test)  is  valid.  A  com¬ 
mon  method  used  to  establish  job  relatedness  is 
with  a  validation  study.  Lastly,  if  business  necessi¬ 


ty  is  established,  the  burden  of  proof 
shifts  back  to  the  plaintiff  to  demon¬ 
strate  that  the  employer  failed  to  use  a 
selection  device  that  is  equally  effective 
but  has  a  lesser  disparate  impact. 

Many  legal  cases  are  related  to  physi¬ 
cal  testing  and  involved  the  use  of 
height  and  weight  standards  and  tests 
for  selecting  public  service  employees 
such  as  police  officers  and  firefighters. 
The  outcome  of  the  litigation  largely 
depends  on  the  scientific  quality  of  val¬ 
idation  study.  The  recent  court  ruling  of 
Lanning  versus  SEPTA  (U.S.  3rd  Circuit 
1999)  will  likely  have  a  major  impact  on 
physical  testing.  This  case  addresses  the 
physical  condition  of  police  officer  can¬ 
didates  and  the  use  of  a  V02max  test  to 
measure  aerobic  capacity.  An  aerobic 
fitness  cut-score  representing  a  V02max 
of  42.5  ml/kg/min  was  found  to  be 
unacceptable  by  the  court.  An  option 
offered  by  the  U.S.  3rd  Circuit  Court  was 
the  validation  of  an  aerobic  fitness  cut¬ 
off  score  that  measures  the  minimum 
capacity  necessary  to  perform  the  job. 
In  the  remand  of  the  case  from  the  U.S. 
3rd  Circuit  Court  and  based  on  Findings 
of  Fact  and  Conclusions  of  Law,  the  U.S. 
District  Court  for  the  Eastern  District  of 
Pennsylvania  ruled  that  SEPTA  met  its 
burden  of  establishing  the  business 
necessity  of  its  aerobic  capacity  stan¬ 
dard  of  42.5  ml/kg/min.  Central  in  the 
Court's  decision  was  the  rejection  of  the 
common  practice  of  setting  a  cut-score 
on  a  physical  ability  test  one  standard 
deviation  below  the  average  incum¬ 
bents.  The  Court  recognized  the  need  to 
define  the  minimum  aerobic  qualifica¬ 
tions  needed  to  perform  the  job,  which 
for  SEPTA  officers  was  a  minimum  aer¬ 
obic  capacity  of  42.5  ml/kg/min.This 
ruling  is  consistent  with  established 
physiological  and  ergonomic  principles 
of  selecting  workers  with  the  physiolog- 


For  further  information, 
please  contact: 

Andrew  S.  Jackson,  P.E.D. 
Department  of  Health  and 
Human  Performance 
University  of  Houston 
Houston,  TX  77004 

Ajackson@mail.uh.edu 

ical  capacity  demanded  by 
the  job.  This  suggests  that 
validation  studies  will  not 
only  be  evaluated  by  stan¬ 
dard  psychometric  test  vali¬ 
dation  criteria,  but  also  by 
physiological  validation 
methods.  Physiological  vali¬ 
dation  involves  identifying 
the  physiological  abilities 
that  are  correlated  with  criti¬ 
cal  work  tasks  and  then 
defining  the  minimum  physi¬ 
ological  level  needed  to  meet 
the  demands  of  the  task.  The 
complexity  of  many  work 
tasks  suggests  that  the  physi¬ 
ological  validation  process  is 
a  multivariate  procedure,  n 
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ISCAN  is  the  world's  leading  producer  of  video  based  eye  move¬ 
ment  monitoring  systems.  Since  1980,  our  broad  range  of  prod¬ 
ucts  lias  set  the  pace  for  performance  and  usability  in  wide  rang¬ 
ing  research,  military  and  medical  applications.  We  can  provide 
off-the-shelf  or  customized  solutions  to  suit  virtually  any  human 
factors  application. 


Products  &  Features  Include: 

*  Mon-invasive,  high  resolution,  real-time 
measurement  of  eye  position,  pupil  size  and 
subject's  point  of  gaze. 

*  Complete  Eye  and  Head  Tracking  Laboratories,  with  optional  Benchtop, 
High  Speed  (up  to  240Hz)  and  High  Resolution  versions  available. 

*  Integrated  Eyc/I lead  Tracking  in  VR  Displays. 

-  Ultra  Lightweight  Head  Mounted  Lye  and  Scene  Imaging  Systems. 

*  Specialized  Remote  Mounted  Lye  Imaging  Systems  for  Long  or  Short 
Range  Applications. 

*  Advanced  PCI  Bus  Eye  Tracking  Electronics. 

*  Complete  Data  Acquisition  Hardware  and  Analysis  Software  lor  Determi¬ 
nation  of  Subject's  Visual  Performance. 
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